METHOD AND APPARATUS FOR SIGNALING AMONG A PLURALITY OF 

AGENTS 



STATEMENT OF GOVERNMENT RIGHTS 
5 This invention is related to work performed in contract with the U.S. Government under 
DARPA ITO Contract #N66001-99-C-8514, "Pheromone Robotics", and the U.S. 
Government may have certain rights in this invention, 

PRIORITY CLAIM 

1 0 This apphcation claims the benefit of priority to provisional applications number 

60/222,165, filed in the United States on August 1, 2000, and titled "Virtual Phermone 
Messaging System". 

BACKGROUND 

15 (1) Technical Field 

The present invention is related to the field of data signahng. More specifically, this 
disclosure presents a method and apparatus for local signaling among a plurality of 
agents in order to assist in coordination and messaging therebetween. 

20 (2) Brief Discussion of the Prior Art 

Over the past several decades, the electronic communications field, particularly in the 
area of wireless communication, has exploded. In addition, the abilities of small 
processing devices have increased considerably while the cost of these devices has 
decreased. Wireless communication generally takes place between specific devices or 
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nodes. In order to perform tasks such as developing routes through a network, it is 
necessary to provide each member of a network with a unique identification so that 
specific devices may communicate. For example, in a cellular network or even in an ad- 
hoc network, a unique identification or address is assigned to each device so that it may 

5 exclusively receive calls targeted to its address. In addition, communications in most 
networks also require a "handshake" or mutual acknowledgement that a call, or 
conmiunication, is to be set up. These networks depend on physical reliability in order 
function properly. Various communication properties are used in monitoring the 
performance of individual links in the network in order to adjust parameters of the 

1 0 communication system in order to maximize its effectiveness. 

With the increased computational abihties and reduced cost of small, relatively simple 
devices comes the need for additional communication schemes. In particular, it is 
desirable to take advantage of the processing capability of modem devices while 
1 5 conserving power by using local communications. 



SUMMARY OF THE INVENTION 
The disclosed invention presents an agent for receiving signals fi-om at least one other 
locally spaced agent. The agent comprises at least one signal receiver for receiving a 
20 strength signal having a signal strength from at least one other locally spaced agent; at 
least one data receiver for receiving a data signal including data from at least one other 
locally spaced agent; means for associating each data signal with a strength signal, where 



Page 2 of 62 
HRL055DRAFTC 
8/1/2001 



the data signal and the strength signal associated are from the same other locally spaced 
agent; and means for selecting a data signal based on its associated strength signal. 

The signal receiver and data receiver may be directional receivers, and the selection of 
5 the data signal may be based on its associated strength and an associated signal direction. 
The directional receivers may be designed to divide the space from which they receive 
signals into angular regions, which may be selectively combined to allow for varying 
patterns or varying angular accuracy in the determination of the direction from which a 
digital signal was received. 

10 

An agent may also include the abiUty to approximate the distance to another agent from 
which it has received a signal based on the signal strength of the strength signal 

Additionally, and preferably, the signal receiver and the data receiver are incorporated as 
15 a single receiver, and the strength signal and the data signal are combined into a message 
signal including a signal strength and data. Furthermore, agent is preferably configured 
for receiving the message signal in the form of a digital data packet having a data portion 
with at least one data element. 

20 The agent preferably also comprises a digital processor connected with the receiver for 
receiving the digital data packet; an analog to digital converter connected with the 
receiver and with the digital processor for digitizing the signal strength and for providing 
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the digitized signal strength to the digital processor; and a memory connected with the 
processor for storing digital data packets. 



It is further desirable that an agent incorporates a means for time stamping received 
5 digital data packets and for storing the time stamped received digital data packets in 
memory along with the digital data packets. Mcorporating the a time stamp allows an 
agent to eliminate digital data packets from memory when they have reached a 
predetermined age. Furthermore, signals may be selected based on factors from a group 
consisting of the digital data packet, the signal strength, and the time stamp. 

10 

hi order to ensure that digital data packets are received correctly, it is preferred that an 
agent incorporates a means for checking the vaUdity of received digital data packets, 
wherein digital data packets found invalid are removed from memory. 

15 Furthermore, it is preferred that the agents be configured for receiving message signals of 
different types, and wherein the means for selecting is operated independently for signals 
of each type. 

It is also desirable that an agent be configured to receive message signals including at 
20 least one cumulative data portion. The cumulative data portion provides a mechanism by 
which agents may keep a cumulative record of sorts as a message is passed among the 
plurality of agents. 



Page 4 of 62 
HRL055DRAFTC 
8/1/2001 



The agents may also include a means for generating local data such as a sensor for 
determining local environmental characteristics, and may use the local data generated to 
modify the cumulative data portion of the message from the signal. In this case, the 
means for selecting a signal may utilize the cumulative data portion in the selection 
5 process. It is preferable that at least a portion of the cumulative data portion of the digital 
packets use the signal strength from the strength signal to accumulate a cumulative 
strength measure. 

Additionally, and preferably, the agent further comprises a transmitter connected with the 
10 processor for transmitting a digital signal including a digital packet to at least one other 
locally spaced agent. 

It is also desirable that the agent comprise a means for detecting when a signal just 
transmitted by the transmitter is is received back in the receiver in order to detect 
15 reflection from objects near the agent and a means for determining the signal strength of 
the signal and for using the signal strength to approximate the distance of an object from 
the agent. 

The transmitters and receivers are preferably selected from a group consisting of optical 
20 receivers, acoustic receivers, and radio frequency receivers. More preferably, however, 
both the transmitters and receivers operate in the infrared region. 
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As with the receivers, the transmitters may be directional transmitters and may transmit 
in combinable angular regions. 

Preferably, the transmitters are configured to transmit a signal including a data packet 
5 including the modified cumulative data portion of the selected signal. 

The transmitters may also be configured to vary the strength of transmission. This allows 
the agents to adjust to varying levels of congestion and to minimize signal colUsions. 
Receiving agents may be provided with data regarding the strength of a transmission in 
10 order to accurately determine the distance fi^om which a signal is received, and the signal 
strength used in selecting a signal may be an adjusted signal strength which takes into 
account the variation in the transmission strength of a signal. 

The disclosed invention also includes the method by which the agents communicate. 

15 Generally, the method comprises the steps of receiving, at an agent from another locally 
spaced agent, at least one strength signal having a signal strength; receiving, at an agent 
fi-om another locally spaced agent, at least one data signal including data; associating 
each data signal with a strength signal, where the data signal and the strength signal 
associated are from the same other locally spaced agent; and selecting a data signal based 

20 on its associated strength signal 

Jix the receiving steps, strength signals and data signals may be received firom a direction, 
and the direction fi-om which a signal was received may be factored into the selection 
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step. The signals may be received jfrom angular regions, and a step of selectively 
combining the angular regions may also be provided. 

The method may also comprise a further step of approximating a distance from which a 
5 strength signal has traveled based on the signal strength of the strength signal. 

The strength signal and the data signal may be received in the same receiving step and as 
a single message signal. Furthermore, the message signal may be received in the form of 
a digital packet having a data portion with at least one element. The signal strength of the 
1 0 message signal may be digitized for receipt by a digital processor, and may be stored in a 
memory. 

The method may further comprise the step of time stamping the received digital packets 
and storing the time stamps along with the respective received digital packets. The 
15 selection step may also use elements selected from a group consisting of the digital data 
packet, the signal strength, and the time stamp in the selection of a message signal. 

The method may further comprise a step of checking the vaUdity of received digital 
packets and a step of removing digital packets found invalid from memory. 

20 

hx the receiving step, message signals of different types may be received, and the 
selecting step may be operated independently for signals of each type. 
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In the receiving step, messages including at least one cumulative data portion may be 
received, and the method may further comprise a step of modifying at least one 
cumulative data portion of the digital packets. The method may further comprise a step 
of generating local data and the modifying step may use the local data for modifying the 
5 cumulative data portion. The selecting step may also use the cumulative data portion as a 
factor in selecting a message signal, hi the receiving step, the, the cumulative data 
portion of the signal received may include a cumulative strength measure, and in the 
modifying step, the signal strength of the received signal may be used to modify the 
cumulative strength measure of the cumulative data portion. 

10 

The method preferably further comprises the step of transmitting a digital signal, 
including a digital packet, from the agent to at least one other locally spaced agent. 

hi order to provide for object detection, the method may further comprise a step of 
1 5 detecting when the same signal just transmitted by the transmitter is received back in the 
receiver in order to detect reflection from objects near the agent, and a step of 
determining the approximate distance from an object based on the strength of the signal 
received. 

20 Li the receiving step and in the transmitting step, the signals received and transmitted, 
respectively, are preferably from the group consisting of optical signals, acoustic signals, 
and radio frequency signals. Most preferably, the signals are infrared signals. 
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Additionally, signals may be transmitted in a direction such as in an angular region and in 
an additional step, angular regions may be selectively combined to allow for different 
angular accuracy in the determination of the direction to which a digital signal is 
transmitted. 

5 

In the transmitting step, the signal transmitted may include a data packet including the 
modified cumulative data portion of the selected signal 

Furthermore, the method may comprise a step of optionally varying the transmission 
1 0 strength. In the transmission step, the data packet transmitted may include information 
regarding the transmission strength of the transmitted signals, and the selecting step may 
further comprise a sub-step of using received information regarding the transmission 
strength to account for the altered strength of a signal when selecting from among 
signals. 

15 

The operations of the present invention may also be embodied in a computer program 
product stored on a computer writable medium such as an optical storage device such as a 
compact disc (CD) or digital versatile disc (DVD), or a magnetic storage device such as a 
floppy disk or magnetic tape. 

20 

BRIEF DESCRIPTION OF THE DRAWINGS 
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These and other features, aspects, and advantages of the present invention will become 
better understood with regard to the following description, appended claims, and 
accompanying drawings where: 



5 FIG. 1 is a perspective view of a directional signaling mechanism used in conjunction 
with the present invention; 

FIG, 2 is a perspective view of depicting several directional signahng mechanisms as 
shown in FIG. 1, and demonstrating a hop-count-based signaling scheme; 
FIG. 3 is a diagram detailing the messaging format of the present invention; 
10 FIG. 4 is a diagram detailing the data packet portion of the message format depicted in 
FIG. 2; 

FIG. 5(a) is a block diagram depicting a preferred configuration of the receiver portion of 
the present invention; 

FIG. 5(b) is a block diagram depicting the details of the connection between each infrared 
1 5 receiver and the digital processor of the present invention; 

FIG. 6 is a block diagram depicting the details of a directional transmitter portion of the 
present invention; 

FIG. 7 is a flow chart depicting the steps involved in vahdating incoming digital signals 
for storage in the validated messages memory; 
20 FIG. 8 is a table used to provide a narrative description to give a better understanding of 
the steps involved in validating incoming signals; 

FIG. 9 is a flow chart depicting the steps involved in selecting messages from the 
validated messages memory for storage in the selected messages memory; 
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FIG. 10 is a table used to provide a narrative description to give a better understanding of 
the steps involved in selecting messages from the vaUdated messages memory for storage 
in the selected messages memory and of grouping directional bins; 
FIG. 1 1 is a flow chart providing a detailed procedure for selecting messages from the 
5 vaUdated messages memory for storage in the selected messages memory; and 

FIG. 12 is a flow chart for determining the direction of the dominant cumulative data 
(gradient) by determining the direction from which the optimal dominant data portion 
was received. 

10 DETAILED DESCRIPTION 

The present invention relates to the field of field of data signaling. More specifically, this 
disclosure presents a method and apparatus for local signaling among a plurality of 
agents in order to assist in coordination and messaging therebetween. The following 
description is presented to enable one of ordinary skill in the art to make and use the 

15 invention and to incorporate it in the context of particular applications. Various 
modifications, as well as a variety of uses in different applications will be readily 
apparent to those skilled in the art, and the general principles defined herein may be 
appHed to a wide range of embodiments. Thus, the present invention is not intended to 
be limited to the embodiments presented, but is to be accorded the widest scope 

20 consistent with the principles and novel features disclosed herein. 

In order to provide a working frame of reference, first a glossary of terms used in the 
description and claims is given as a central resource for the reader. Then, a brief 
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introduction is provided in the form of a narrative description of the present invention to 
give a conceptual understanding prior to developing the specific details. 

Glossary 

5 Before describing the specific details of the present invention, it is useful to provide a 
centralized location in which various terms used herein and in the claims. The terms 
defined are as follows: 

Agent -As utilized herein, the term agent indicates a unit comprising, in its most general 
10 sense, at least one signal receiver and at least one data receiver, wherein the signal 

receiver is used to receive a signal useful for determining a signal strength, and wherein 
the data receiver is used for a data signal. Generally an agent includes a processor for 
operating software for facilitating the functions of the invention. For example, software 
may provide a means for associating a strength signal with a data signal. The signal 
1 5 receiver and the data receiver are typically the same unit. A memory is also included in 
the agent for storing received data as well as data generated by the agent. Assuming that 
the agent operates on digital data, an analog to digital converter can be provided to 
generate a digital representation of the strength of incoming signals. The agent may also 
include a transmitter for sending signals to other, locally spaced, agents. Both the 
20 transmitter and receiver may be directional in nature. Agents may also include many 
other features such as additional sensors for detecting properties of the environment and 
additional communication mechanisms as well as mechanisms to provide mobility. 
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Analog to Digital Converter - The term analog to digital converters as used herein is 
intended to include any analog to digital conversion mechanism useful for generating a 
digital representation of the strength (or power level) of an incoming signal. 

5 

Angular Region - With reference to a signal transmitter or receiver, the term angular 
region is intended to indicate an arc (either in two dimensions or three) representing the 
angular granularity used for determining the direction (either with respect to the agent or 
with respect to another reference point) from which a signal is transmitted or received. 

10 

Cumulative Data Portion - The cumulative data portion of the a signal is a place within 
the signal where data intended to be modified (typically with local data) at each hop 
across a plurality of agents is kept. The modification of the cumulative data portion may 
be performed simply as an increment/decrement of a hop count, or it may be more 
15 complex, incorporating local data derived from sensors on board an agent. Combined 
with a direction from which it is received, the cumulative data portion can represent a 
quality of a gradient path across a plurality of agents. 

Local - The term local as used herein is intended to be indicative of a close range, the 
20 exact distance of which varies with the particular embodiment. Preferably, local 

indicates that communication between agents is limited to nearby agents such as those 
immediately neighboring an agent. Depending on the level of agent congestion, the 
physical range at which agents are considered to be local with respect to one another may 
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be varied by altering transmission power or receiving sensitivity. This can, for example, 
prevent an agent from losing contact with the other agents by extending the 
communication range of that agent. On the other hand, it can also prevent packet 
collisions from excessively disrupting communications by reducing the communication 
5 ranges of a group of agents. 

Signal Receiver - A signal receiver for use with the present invention is preferably 
operational with a communication medium exhibiting qualities including a high 
directionality, easy modulation, and an intensity that decreases with increased distance 

10 from the sender such that it may be used effectively for distance estimation. Examples of 
mediums satisfying these criteria include optical, acoustic, and radio frequency signals. 
The preferred medium is infrared radiation. It is further preferred that the signal receiver 
be ftmctional for determining the direction from which an incoming signal is received. 
Thus, in the case of an infrared receiver, several individual directional receivers maybe 

15 incorporated to form a directional receiver, with each of the individual receivers being 
responsible for receiving in a particular direction with respect to an agent. The individual 
receivers may be grouped in various ways to form receiving patterns. This grouping may 
be performed either in hardware or by grouping the information received from the 
receivers using software (e.g., by storing the information from each group of receivers in 

20 a particular bin in memory and operating on the information in each bin as a group). 

Signal Transmitter - A signal transmitter for use with the present invention is preferably 
operational with a communication medium exhibiting qualities including a high 
directionality, easy modulation, and an intensity that decreases with increased distance 
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from the sender such that it may be used effectively for distance estimation. Examples of 
mediums satisfying these criteria include optical, acoustic, and radio frequency signals. 
The preferred medium is infrared radiation. It is further preferred that the signal 
transmitter be functional for determining the direction in which an outgoing signal is 
5 transmitted. Thus, in the case of an infrared transmitter, several individual directional 
transmitters may be incorporated to form a directional transmitter, with each of the 
individual transmitters being responsible for transmitting in a particular direction with 
respect to an agent. The individual transmitters may be grouped in various ways to form 
transmitting patterns. This grouping may be performed either in hardware or by 
10 distributing the information transmitted among the transmitters using software. 

Data Signal - The term data signal is used herein simply to indicate a signal intended to 
transmit information between agents. 

1 5 Message Signal - Although it is possible to transmit a data signal and a strength signal 
separately (e.g, the strength signal could be in a medium which loses strength in 
proportion to distance rapidly such as an acoustic signal, whereas the data signal could be 
in a medium that loses strength in proportion to distance slowly such as a laser), it is 
desirable that the signal that transmits information between agents be the same signal 

20 used in determining signal strength. Therefore, the term message signal is simply used as 
a convenient label for indicating a signal used both for transmitting information between 
agents and in determining signal strength. 
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Strength Signal - The term strength signal is used herein simply to indicate a signal 
intended to facilitate determination of its strength. 

Type - Type is generally used to indicate a particular class of cumulative data (which is 
modified by a particular class of local data). For example, in a case where two types of 
cumulative data are used, and one message structure is used wherein a cumulative data 
portion of the messages have the same addresses within the message structure, a type 
portion should also be provided to prevent undesired mixing and confusion between the 
different types of cumulative data. More tangibly, in a case where a cumulative signal 
strength measure and a cumulative measure of a particular toxin are passed through a 
plurality of agents, it is desirable to provide a means for separating the cumulative data 
representing the different cumulative measures. This is a goal of the type. 

Introduction 

The present invention provides a method and an apparatus for signaling among a plurality 
of agents. More specifically, the signaling is designed to support communication 
between nearest neighbor transceivers. The agents of the present invention may be 
roughly viewed as signal filters. Messages are received by the agents, and the agents 
select only the "best" messages according to some criteria either for processing internally 
or for re-transmission to the local neighboring agents of the receiving agent, or a 
combination of the both. Thus, in the communication scheme disclosed herein, there is 
no need to keep track of unique agent identifications or addresses. 
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In a simple case, the selection of a signal may be based on signal strength. Assuming that 
all agents are transmitting with the same power level, the signal strength can serve as a 
measure of distance or as a measure of the opacity of the environment with respect to the 
particular type of signal. A cumulative measure of the signal strength may be kept with 
the signal while it is passed among the agents. At each agent, a direction from which a 
signal was received may be maintained, and the strength of the locally received signal 
may be added to the cumulative measure. In this manner, it is possible to gain a rough 
estimate for the overall opacity of a particular path (potentially the "best" path) through 
the agents or a rough estimate of the path length. 

In a variant of this scheme, messages c^n be moved in a specific direction through a 
group of agents if directional transmitters are employed. The same mechanism can be 
used for obstacle sensing, if the agent can identify when a message that was just 
transmitted is received unchanged (i.e., the signal is reflected). 

The signaling method incorporated in the present invention may also be envisioned as 
loosely analogous to the properties of chemical pheromones used by social insects such 
as ants and termites. In nature, pheromones and pheromone gradients based on local 
signals are used extensively to produce organized group activities that appear very 
sophisticated despite the fact that each individual insect may be relatively simple. The 
signaling mechanism described herein is useful in robotic applications where there is a 
need to enable a large number of cooperating robots to exhibit many of the emergent self- 
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organizing properties of insect colonies. It also supports additional capabilities by virtue 
of the ability of the messages to carry additional information. 

Some key properties of the signaling mechanism of the present invention are used to 
facilitate group organization. First of all, a sender of a message need not be concerned 
with the identity of the recipient, nor does the sender need any guarantee that the message 
has even been received. This makes the messaging system ideal for communication 
within large populations of simple agents where the implementation of complex protocols 
or the coding of unique identities may be impractical. The messages provide important 
navigational cues to members of a group by way of the directional intensity gradients 
created from message diffusion. Diffusion gradients also encode useful information 
about barriers in the environment since physical obstacles may block message 
propagation. Another key property of the signaling system described herein is the ability 
to decay or eliminate stored messages over time if they are not replaced. This prevents 
cluttering the plurality of agents with obsolete or irrelevant information. 

Specifics of the Present Invention 

An example of a simple agent with a directional signaling mechanism is depicted in FIG. 
1. As shown, the agent 100 includes a digital processor 102, a transmitter 104, and a 
receiver 106. The transmitter 104 is depicted in the figure as an omni directional 
transmitter. However, depending on the requirements of a particular embodiment, the 
transmitter 104 may be a directional transmitter configured similariy to the receiver 106. 
The receiver 106 is depicted as a directional receiver having a plurality of angular regions 
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108 for receiving signals coming from particular angles with respect to the agent. The 
individual angular regions 108 of the receiver 106 may be selectively combined in order 
to vary the angular accuracy (or tolerance) in determining the direction from which a 
signal is received. The individual angular regions 108 may be grouped either by 
proximity to each other (e.g., grouping neighboring angular regions 108) or they may be 
grouped in patterns (e.g., grouping angular regions 108 in front of the agent 100 with 
those in back of the agent 100). 

Although it is preferable that the same signal be used for transmitting data and for 
determining signal strength, is also conceivable that the receiver 106 comprise different 
components for receiving different components of a signal. For example, the agents 100 
may include a transmitter specifically for transmitting a signal from which signal strength 
is to be inferred and a transmitter specifically for transmitting a conmiand (data). In an 
embodiment of this example, the transmitter 104 could provide a red beacon for from 
which another agent 100 may determine its signal strength and correlate its distance. The 
commands could be transmitted via a blue beacon. Therefore, if an agent 100 was 
progranmied to respond only to signals from an agent 100 at a particular distance within a 
given time frame, the agent 100 could simply wait for the proper combination of a red 
beacon and a blue beacon before it reacts to a command. In this embodiment, the agent 
100 would typically have a signal receiver for receiving a strength signal, a data receiver 
for receiving a data signal (e.g., a command), a means for associating each data signal 
with a strength signal, and a means for selecting a data signal based on the strength of the 
associated strength signal. The means for associating each data signal with a strength 
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signal could, for example, be based on the direction from which a signal was received. 
The means for selecting a data signal based on the strength of the associated strength 
signal is typically in the form of software operating on the processor of the agent 100, 
which processes the received signal strengths in order to make a selection. Thus, as 
mentioned in the introduction, the agent can simply act as a sifter, waiting for the proper 
combination of signal strength and command before reacting. 

The transmitter 104 and the receiver 106 may operate using various communication 
medium, non-limiting examples of which include optical, radio frequency (RF), and 
acoustic mediums. It is desirable that the communication medium be highly directional, 
easily modulated, and that it lose intensity with increased distance from the sender. The 
directional property is needed to permit directional signahng and is usefiil for the 
development of path gradients. Modulation is needed to encode the message type and 
other data. Distance drop-off is usefiil for allowing agents to estimate their distance from 
the sender. It is further desirable that the communication medium provide for line-of- 
sight propagation to ensure that message gradients do not pass through walls or other 
obstacles, although some applications of this system may use a signaling medium that is 
not limited to line-of-sight signaling. The preferred medium for use with the present 
invention is infrared (IR) used in conjunction with a directional transmitter and a 
directional receiver. Note that although depicted as a two-dimensional perimeter of 
angular regions, the receiver 106 could also take the form of a three-dimensional 
directional receiver. The same concept could also be applied to the transmitter 104. 
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A perspective view of agents 100 with directional signaling mechanisms is depicted in 
FIG. 2. The agents 100 are each shown transmitting a signal 200 for receipt by another 
agent 100. A cumulative data portion 202 is shown relative to each signal 200. The 
agent 100 includes means for modifying the cumulative data portion 202. Typically, 
local data is used to modify the cumulative data portion 202 in order to generate a 
modified (or new) cumulative data portion for further transmission. In the scenario 
depicted, the cumulative data portion 202 is represented as an integer hop count, starting 
with an initial value of 100 and decremented with each hop through the plurality of 
agents 100. For purposes of the plurality of agents 100 depicted in FIG. 2, the 
transmitters 104 of the agents 100 are assumed to be directional transmitters, transmitting 
messages away from the agent 100 from which a signal is received. For illustration, the 
first agent 100a begins with a value of 100 stored in cumulative data portion and 
transmits a signal including the cumulative data portion 202, which is received by its 
local neighbor agents 100b and 100c. The neighbor agents 100b and 100c then 
decrement the value stored in the cumulative data portion by a factor of 1, representing 
the fact that the signal has incurred one hop between the first agent 100a and the neighbor 
agents 100b and 100c. Next, the agents 100b and 100c transmit signals with cumulative 
data portion values of 99 in a dfrection away from the first agent 100a, with the signal 
from agent 100b being received by agent lOOd and with the signal from agent 100c being 
received by agent 100b and lOOe. Note that the signal from agent 100c is transmitted to 
agent 100b with a lower value stored in its cumulative data portion (99) than in the 
cumulative value portion of the signal from agent 100a (100). In cases where an agent 
100 receives two signals, one with a higher value stored in the cumulative data portion 
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and one with a lower value stored in cumulative data portion, the agent 100 may be 
programmed to select the signal with the higher value stored in cumulative data portion, 
as indicative of a shorter route to the originating agent 100a. Note that depending on the 
particular embodiment, the determination of which signal to select may take place in 
many different ways. For example, the local data used to modify the cumulative data 
portion 202 may be given a weight relative to the cumulative data portion 202, or the 
selection may be made based on different criteria. Li some cases, it may be desirable to 
select the signal in a manner where the data stored in the cumulative data portion meets 
certain criteria, not simply a highest or lowest value, as indicative of a particular 
environmental feature. Furthermore, the local data used to modify the cumulative data 
portion 202 need not simply be a hop count, and could be, for example, a measure 
determined from the local incoming signal strength (thus keeping a cumulative signal 
strength measure across a pluraUty of agents 100), or it may also be developed from other 
sensors on board the agent. The important aspect of the local data used to modify the 
cumulative data portion is that it is a measure of some local envirormiental property, 
whether the environmental property is a simple hop coimt, a measure of the signal 
strength, a measure of the distance to the transmitting agent, a more complex measure 
determined by other sensors on board the agent, or a combination of properties. 
Additionally, the agents may be configured to provide multiple types of data in different 
cumulative data portions 202, each processed independently such that gradients 
representing different features may be generated in the plurality of agents. Thus, for 
example, in addition to a simple measure of hop count to an originating agent, a measure 
of temperature changes (or the highest temperature along the path) or steepness may be 
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generated to provide a broader picture of the environment along the path. The different 
types of cumulative data may also be "superimposed" to provide composite data while 
still allowing observation of individual cumulative data component types. 

An example of a message structure that may be used in conjunction with the present 
invention is depicted in FIG. 3. Because of its message validating features, this message 
structure is particularly useful in an environment where collisions are frequent, and it is 
used as a wrapper for transmitting a digital data packet, including at least one data 
element, on the message signal. One advantage of the signaling mechanism of the 
present invention is that it does not require acknowledgement of messages, and lost 
messages are acceptable. The message structure includes a start bits portion 300, which 
provides an indication of the start of a message. This portion is used by an agent 100 in 
order ensure that it receives a message from its beginning. A length count portion 302 
provides the agent 100 with a measure of the message length to expect. This serves as a 
mechanism to check for completeness of the message and also to facihtate the use of 
variable-length messages. If variable-length messages are not desired, and a standard 
length is used, the length count portion 302 is not usefixl. A data packet portion 304, 
which will be discussed in greater detail below, allows for the transmission of a 
cumulative data portion 202, as well as a type and, optionally, other data. An error 
checking portion 306 is also included in the message structure in order to provide 
information useful for checking the message to detect errors which may occur during 
transmission. The error checking portion 306 can assist in cases where muhiple 
messages are received from the same direction and portions of the messages become 
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tangled. Note that although it is preferred that the message structure include a start bits 
portion 300, a length count portion 302, a data packet portion 304, and an error checking 
portion 306, one or more of these portions may be eliminated depending on the needs of 
the particular embodiment. In a simple case, for example, the message structure includes 
only portions necessary for transmitting a cumulative data portion 202. Note that the 
start bits portion 300, the length count portion 302 and the error checking portion 306 
serve as an example of a mechanism for validating messages. Messages found to be 
invalid may be removed from memory, or if the invalidity is found during transmission, 
the message may simply be ignored by the agent 100. Virtually any error checking or 
packet validating scheme known in the art may be used in conjunction with the present 
invention. 

A preferred format for the data packet portion 304 is shown in FIG. 4. As shown, the 
data packet portion 304 includes a type portion 400, a cumulative data portion 402, and 
an other data portion 404. The type portion 400 allows for different types of cumulative 
data to be transmitted in the same bit locations of different data packet portions 304. For 
example, it may be desirable to provide a type of cumulative data which is simply a hop 
count along a path from an originating agent 100. On the other hand, it may also be 
desirable to provide a type of cumulative data which is a measure of distance along the 
path from an originating agent 100. Various schemes for developing cumulative data 
may be incorporated simultaneously by generating different cumulative data types, and 
indicating the cumulative data type in the type portion 400 of the data packet portion 304. 
Other schemes using the type portion 400 may be developed. For example, some 
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messages may be designed to provide commands to all of the agents 100, and these 
messages could be tagged with a specific type to ensure that they are processed as 
commands by the agents 100. The type portion 400 could also be used to cause the 
agents 100 to re-transmit a particular message in a particular direction, or to ensure that a 
particular message is not re-transmitted. Functions such as these could also be 
implemented through the other data portion 404. 

In addition to simply utilizing cumulative data of different types, as suggested previously 
it is also possible to combine cumulative data of different types in order to generate 
weighted cumulative data of a new type. This scheme is roughly analogous to the 
generation of different pictures on different transparencies, and overlaying the different 
transparencies to generate a composite picture. Li the case of the present invention, 
gradients may be developed for different types of cumulative data, and maintained as 
separate components in addition to a combined cumulative data gradient. 

The cumulative data portion 402 of the data packet portion 304 is used for transmitting 
the cumulative data to neighboring agents 100. At each agent 100, information including 
local data is combined with the cumulative data portion 402 of a message received in 
order to generate a new data packet portion 304 for transmission. As previously 
mentioned, each cumulative data type maybe differentiated through the use of a type 
portion 400. Again, in the simple case of a cumulative data portion 402 incremented by a 
hop count, the cumulative data portion 402 transports the current cumulative data to a 
receiving agent 100, where local data in the form of an incrementing factor (typically 1) 
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is used to augment the current cumulative data to generate a new cumulative data portion 
(typically equal to the current cumulative data value plus 1). This new cumulative data 
portion 402 is inserted into the data packet portion 304 for transmission to local neighbor 
agents 100. This process is repeated as the signal is propagated through the plurality of 
agents 100. 

In some cases, it may be desirable to include data in addition to the cumulative data in the 
data packet portion 304. In this case, an other data portion 404 may be included in order 
to facilitate transmission of additional information in the message. For example, if an 
agent along the path is damaged, it may be desirable to include that information in the 
other data portion 404 of the data packet portion 304 in order to inform a user of the 
system that one of the agents 100 is in need of repair. Depending on the particular 
embodiment, the path to the damaged agent 100 may be included along with the 
cumulative data at the damaged agent 100 so that the user may find the damaged agent 
100. Alternatively, a unique identifier for the damaged agent 100 may be included so 
that the user may identify the agent directly rather than simply by means of a path to the 
agent 100 along with the hop count at the agent 100. 

Generally, it is desirable to retain the direction from which a signal is received along with 
the cumulative data associated with the signal in order to encode a gradient. The 
direction of the gradient at an agent need not be transmitted with a new or modified 
cumulative data portion. 



Page 26 of 62 
HRL055DRAFTC 
8/1/2001 



If multiple messages are received from the same direction with the same type-field value, 
and the messages do not collide, the receiving agent 100 will generally select the message 
with the greatest signal intensity for re-transmission. This will help to ensure that 
messages from only the closest transmitters are considered, and will also provide the 
receiver with an estimate of the range to its closest neighbors. Variations on this scheme 
are also contemplated, such as selecting the message based on a predetermined or 
selected intensity rather than simply based on the greatest intensity. Thus, signals from 
agents 100 at a particular range may be selected. Additionally, depending on the features 
provided in a particular embodiment, the selecting of a message may be based on one or 
more factors, a few examples of which include the local signal sfrength, features of the 
digital data packet portion 304 such as the value of the cumulative data portion 402 (non- 
hmiting examples of which include hop count, cumulative signal strength, and other 
environmental data), the contents of the other data portion 404, the distance estimated 
from the local signal strength, a time based mechanism such as a time stamp, and the 
direction from which a signal was received. 

Despite the fact that only the nearby neighbors will receive a message transmission, the 
relay mechanism provided herein allows any smgle message to potentially propagate 
through an entire array of agents 100, with each agent 100 connected by an unmterrupted 
local neighbor communication chain to the originator. Furthermore, it is possible for any 
recipient to determme an optimal path (which in some cases may represent an 
approximate distance) to the originator of the message as well as the local gradient that 
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leads toward the originator. These properties are very important, for example, in 
enabling world-embedded computation-type uses. 

A block diagram depicting a preferred configuration of a receiver portion of the present 
invention is shown in FIG. 5(a), with details of the connection between each infrared 
receiver and the digital processor shown in FIG. 5(b). The agents 100 preferably contain 
a both a receiver portion and a transmitter portion. However, it is envisioned that in some 
cases, it may be desirable for agents ICQ to have only a receiver portion, e.g., to serve 
only as indicators of the value of the cumulative data portion at certain points without 
passing on messages themselves, or to have only a transmitter portion, e.g., to serve as 
beacons for originating signals to be propagated throughout the pluraUty of agents 100. 
More detail regarding the receiver portion of the agents 100 will now be presented. 

The preferred configuration of the receiver portions is depicted in FIG. 5(a), including an 
infrared receiver 500 for receiving an incoming digital signal, an analog to digital 
converter 502 connected with the infrared receiver 500 for receiving the analog signal 
strength from the digital signal and converting it into a digitized representation of the 
signal strength. Note that an individual infrared receiver 500 along with a representation 
of the analog signal strength 504, the analog to digital converter 502, and the digitized 
signal strength 506 is depicted in FIG. 5(b). Both the analog to digital converter 502 and 
the infrared receiver 500 are connected with a digital processor 508. The digital 
processor 508 is configured to receive the received digital signal 510 from the infrared 
receiver 500 and the digitized signal sfrength 506 from the analog to digital converter 
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502. Note that in FIG. 5(a), the infrared receiver 500 is depicted as a plurahty of infrared 
receivers 500, each for receiving a digital signal from a different angular region with 
respect to the agent 100. Each individual infrared receiver 500 is capable of providing 
both a data output as well as a signal strength output. When messages are received, the 
digital processor records the direction and signal strength along with the message content 
from the digital data packet portion 304 in a memory 512. Preferably, a timestamp is 
recorded as well. - 

A memory 512 is supplied, and is preferably divided into a valid messages memory 514 
and a selected messages memory 516. The valid messages memory 514 serves as a 
storage area for messages determined to be valid by a vaUdity checking routine. The 
selected messages memory 516 serves as a repository for messages that have been 
selected from the vahd messages memory 514 for modification and retransmission. The 
routines for validating messages for entry into the valid messages memory 514 and for 
selecting messages from the vahd messages memory 514 will be discussed in greater 
detail below. 

A block diagram depicting a preferred embodiment of the transmitting portion of an 
agent 100 is depicted in FIG. 6. Preferably, the transmitting portion is capable of 
sending both omni directional and directional messages. The transmitter portion is 
depicted as a plurality of directional infrared emitters 600, each connected with a 
transmit-enable unit 602, which can selectively enable ones of the plurality of infrared 
emitters in order to provide the desired transmission directionahty. The transmit-enable 
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unit 602 is controlled by a digital processor 508, which may be the same or may be in 
addition to the digital processor 508 in the receiving portion. A send messages queue 604 
is also provided, in which messages to be sent are prepared for transmission. Generally, a 
message to be transmitted is sent to all of the infrared emitters 600, but only those 
enabled will actually transmit. 

In some cases, such as when congestion exists among the agents 100 and many signals 
colhde en route to a receiver, it may be desirable to vary the signal strength generated by 
the transmitting portion of one or more agents 100. The other data portion 404 of the 
digital data packet portion 304 may include information regarding the signal strength 
output of the transmitting portion in order to enable the signal strength at a receiving 
agent 100 to properly reflect its distance from the transmitting agent 100. The receiving 
agent 100 may then use this infomiation to adjust its processing of the received signal in 
order to account for the altered signal strength when selecting among signals. 

A flow chart depicting the steps involved in validating incoming digital signals for 
storage in the validated messages memory 514 is provided in FIG, 7. As shown, the 
receiving portion of an agent 100 waits for data 700. Once a digital signal has been 
received, the receiving portion determines whether the received digital signal includes a 
start bits portion 701. If no start bits are detected, the agent 100 reverts to waiting 700, 
waiting to detect another incoming digital signal. If start bits are detected, the receiving 
portion of the agent 100 then reads the length count portion 302 of the digital data packet 
portion 304 of the digital signal in order to determine the expected length of the digital 
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signal 702. The receiving portion of the agent 100 then reads the digital signal to 
determine whether the actual length of the digital signal is equal to the expected length of 
the digital signal 704. If the message is too short 706, the receiving portion assumes that 
a message collision 708 has occurred and goes back to the waiting step 700. If the actual 
message length matches the expected message length, then the receiving portion uses the 
error checking portion 306 of the received message to determine whether there is an error 
in the received message 710. If an error is present, the receiving portion assumes that a 
message collision 708 has occurred and goes back to waiting 700. If no error is present 
in the message, the receiving portion reads the signal intensity 712 and enters the 
message into memory along with the signal intensity, the direction, and, preferably, a 
time stamp 714. Note that in this scheme, all properly received messages are recorded 
into the valid messages memory 514, along with the signal intensity, the direction, and, 
preferably, a time stamp. 

A table is presented in FIG. 8 in order to provide a narrative description of the steps 
involved in vaUdating incoming signals. The table represents example fields used in the 
valid messages memory, along with a group of example entries. The first column in the 
table is a Ust of the type portions 800 from various received messages. In the table, 
messages stored in the valid messages memory 514 are grouped by type. Within each 
type, the messages are then grouped by direction using a direction column 802. Each 
unique entry in the direction column 802 (e.g., each unique number appearing in the table 
in the direction column 802) represents the particular direction, generally relative to the 
agent 100, from which a message has been received. The value stored in the direction 
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column 802 can correspond to the actual receiver 108 that received the message, or more 
generally, it may be a in the form of a direction vector in two or three dimensions that 
points in the direction, with respect to the agent 100, from which the received message 
was detected. Note that for illustration, bins 804 are defined in the validated messages 
memory 514, into which signals are grouped. Naturally, messages from each unique 
number appearing in the table in the direction column 802 are considered to be in the 
same bin 804, as depicted by 804a. However, bins 804 may also be generated as 
combinations of direction numbers, as depicted by 804b, in order to lump individual 
receivers 500 together to control the directional granularity with which messages are 
recorded. Specifically, in the case depicted in the table of FIG. 8, messages from bins 0 
and 1, 2 and 3, 4 and 5, and 6 and 7 are grouped. Bins 804 may be grouped in any 
arbitrary manner in order to implement different connectivity grid pattems among the 
agents 100, e.g., octagonal versus hexagonal versus rectangular. In cases where the 
agents 100 are mobile, they can move so as to try to maintain one and only one local 
communicating agent 100 in the direction of each bin 804. 

The valid messages memory table also includes a local data column 806, where local data 
for modifying the cumulative data is stored. The local data may simply be factor by 
which the cumulative data received should be incremented, or it may be a measure of the 
intensity of the signal received. As previously mentioned, the local data can be broadly 
defined as any local environmental property along the path the message traveled to reach 
the agent 100, A message time stamp colunrn 808 is also provided in order to store time 
stamps to indicate the time a message was received. The time stamp provides a 
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mechanism for decaying or eliminating messages after they reach a predetermined age. 
Additionally, a cumulative data column 810 is provided in order to store the information 
from the cumulative data portion 402 of the message. Finally, an other data column 812 
is also included in the table to enable the storage of additional data from the other data 
5 portion 404 of the message. 

A flow chart depicting the steps involved in selecting messages from the validated 
messages memory 514 for storage in the selected messages memory 516 is provided in 
FIG. 9. Generally, the messages are sorted by type in a message type sorting step 900. 

1 0 Next, if the messages are provided with time stamps, the time stamps of the messages are 
observed and expired messages are removed from the validated messages memory 514 in 
an expired messages removing step 902. After the expired messages have been removed, 
the remaining messages are sorted by direction within each type group in a direction 
sorting step 904. The bins 804 may then be optionally grouped in order to adjust the 

1 5 granularity with which direction is determined in a direction grouping step 906. Next, for 
each bin 804, the message having the greatest signal intensity is determined in a greatest 
signal intensity determining step 908. The message from the signal having the greatest 
intensity is then stored in the selected messages memory 516 in a message storing step 
910. The cycle of the greatest signal intensity determining step 908 and the message 

20 storing step 910 is repeated for each bin 804, until the moving procedure is completed 
912. Note that the steps presented in FIG. 9 do not necessarily have to be performed in 
the order shown, and may be performed in any order useful for achieving the desired 
fixnctionality. 
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Assuming selection based on proximity is desired, the goal of the procedure for moving 
messages from the validated messages memory 514 to the selected messages memory 
516 is to retain, for specified directional bins 804, only those messages that come from 
5 the closest transmitting agents 100. To do this, the messages are grouped into directional 
bins 804, and then only the messages with the strongest signal intensity are selected. The 
use of two memories (the vahdated messages memory 514 and the selected messages 
memory 516) serves to retain alternative messages if the current selected message for a 
given directional bin 804 should expire. In this case, upon expiration of the selected 

10 message from a given directional bin 804, the next best message may be moved into the 
selected messages memory 516 in its stead. Although discussed as two different 
memories, it is important to note that the validated messages memory 514 and the 
selected messages memory 516 may have any configuration desired for a particular 
embodiment. It is conceivable that they may be in the form of physically separate 

15 memories, but generally, they are simply different allocations within the same physical 
memory. 

Note also, for purposes of ensuring that messages from the closest agent 100 in a given 
direction are used, the local signal intensity (that is, the intensity of the actual signal 
20 received rather than the a cumulative intensity measure from the cumulative data portion 
of a message) of all incoming messages from a particular direction is stored and used. 
An additional column may be added to the tables in order to represent local data other 
than the signal strength associated with each message. 
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A table used as a follow-up to the table depicted in FIG. 8 is presented in FIG. 10 in 

order to provide a better understanding of the steps involved in selecting messages from 
the validated messages memory 514 for storage in the selected messages memory 516 

5 and to further illustrate the grouping of directional bins 804. The table depicted in FIG. 
10 includes the same columns as those in the table depicted in FIG. 8, and shows the 
results of operating the steps involved in selecting messages from the validated messages 
memory 514 for storage in the selected messages memory 516. As may be observed, the 
messages for each message type have been grouped and sorted by direction. The 

10 directions have been combined to form bins 804 within each type by combining bins 0 
and 1, 2 and 3, 4, and 5, and 6 and 7. For each bin 804 within each type, the signal 
having the greatest signal intensity has been selected for inclusion in the table shown in 
FIG. 10. In particular, note that the between the two entries with type 10 and direction 1 
depicted in FIG. 8, the entry (message) with the greatest signal intensity of 22 was 

1 5 selected, indicating that the for direction 1 , the entry with the signal intensity of 22 was 
transmitted from the closest agent 100 in direction 1 . With respect to the entry with type 
10 and direction 7, there were no other entries (messages) with the same direction. Thus, 
the entry with signal intensity 34 (the only entry) was selected. With respect to entries 
with type 22, bins 804 of directions 0 and 1 were combined and the entry having the 

20 greatest signal intensity of 66 was selected. The bin 804 for direction 5 had no 

counterpart for combining (e.g., no entry from direction 4), and thus was selected. The 
same principles were applied to the entries of types 36 and 65 to generate the table 
depicted in FIG. 10. 
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A yet more detailed flow chart demonstrating the procedure for obtaining selected 
messages from the valid messages memory 514 for storage in the selected messages 
memory 516 is presented in FIG. 11. Note that in the procedure depicted by FIG. 11, it 

5 is assumed that message directions are stored in radians and that it is desirable to divide 
the messages into a set of K directional bins 804. As depicted in FIG. 9, the messages 
are first sorted by type 900. Next, messages having a time stamp in excess of a desired 
age are eliminated from the memory 902. Then, messages are sorted by direction with 
each type 904. Subsequently, a bin counter is set to a value of 1 1100 and the first 

10 message encountered in the memory is stored in a best message variable 1102. A next 
message variable is then set with a value equal to the next message in the memory 1104. 
After setting the next message variable, a type method or subroutine is called to 
determine whether the field of the best message record is equal to the type message of the 
next message record 1106. If the field of the best message record is equal to the type 

1 5 message of the next message record, the direction from which the next message 

originated is checked to determine whether the next message was received in the same 
angular bin as the current bin (from which the best message was selected) 1108. The 
relationship used is whether the value in the direction field of the next message record is 
less than 2;r/K*Bin where % is the symbol for Pi, K represents the number of directional 

20 bins in a circular set of receivers, and Bin is the bin to which the bin counter was set. If 
the best message and the next message are from the same bin, the local signal strength (or 
whatever criteria is used for selecting a best signal) of the best message and the next 
message are compared to determine whether the next message has a signal strength 
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greater than that of the best message 1110. If the next message has a signal strength 
greater than that of the best message, the next message replaces the current best message 
as the best message 1112 and the next message from the memory is stored in the next 
message variable 1104. If the next message does not have a signal strength greater than 
5 that of the best message, the next message does not replace the best message in the best 
message variable, and the next message from the memory is stored in the next message 
variable 1104. In either case, once a new message has been stored in the next message 
variable, the cycle after the storing of the next message from the memory is stored in the 
next message variable 1104 begins again. If, after a type method or subroutine is called 
1 0 to determine whether the field of the best message record is equal to the type message of 
the next message record 1106, the type of the best message is determined not equal to the 
that of the next message, the bin is set (back, if necessary) to 1 1114, and the best 
message is stored in the selected messages memory 1116. The system then checks to see 
if another message exists in memory 1118 (this is actually depicted in the chart by 
1 5 determining whether the next message entry in the memory is null). If not, the process is 
finished and the best message has been selected (typically for modification, if applicable, 
and transmission) 1120. On the other hand, if another message does exist in memory, the 
content of the best message variable is set equal to the contents of the next message 
variable 1122. Subsequently, the next message from the memory is stored in the next 
20 message variable 1 1 04, and the cycle after the storing of the next message from the 
memory is stored in the next message variable 1104 begins again. Referring back to 
block 1108, if the next message was not received in the same angular bin as the current 
bin (from which the best message was selected), the bin counter is incremented 1124, and 
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the process passes to storing the best message in the selected message memory 1116, and 
subsequent steps. Typically, the goal of the message selection process is to determine 
which message, of those in memory, to modify and re-transmit through the transmitting 
portion. 

After obtaining a set of selected messages, there are several tasks that may be 
accomplished. For obstacle detection, or for detecting ranges to nearby transmitters, the 
direction and signal strength, as well as the actual message contents of each message in 
the selected messages memory may be analyzed. For example, if the same message just 
transmitted is received (within the time expected for reflection from an object in the 
communication medium used), it may be assumed that an object was encountered in 
transmission. The signal strength and the direction from which the signal was received 
may be observed to generate a distance estimate to the object and a direction to the 
object. 

The signal strength of received signals may also be analyzed to estimate the distance to 
an agent 100 from which they were transmitted (the calculation is somewhat different 
than that for determining the distance to an object because of the additional signal 
strength loss due to the two-way route required for reflection from an object). 

Another important task in conjunction with the use of signal strength is the determination 
of the strongest message of each type. Given a communication medium that loses 
strength proportionally with increased distance, a cumulative strength measure may be 
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used to determine a shortest path across a pluraUty of the agents. For each type of 
cumulative data, a dominant gradient may be determined across a plurality of agents. A 
flow chart of this process is depicted in FIG. 12. First, messages are grouped by type 
code 1200. Next, the message with the optimal cumulative data portions 402 
5 (represented in the figure as a maximum cumulative strength value) is selected 1202, If 
more than one message have an optimal cumulative data portion 402, then a tie-breaker 
occurs, and the message with the optimal local data (represented in the figure as the 
greatest local signal strength) is selected 1204 as the final message, and the direction of 
the final message is returned 1206 as an indication of the direction of the dominant 
10 gradient of the type. The process is repeated for each type. 



It is also worth noting that the signaling among the agents may take place periodically 
within predetermined timeframes, so that the selection process may be operated on 
signals received within a particular timeframe. Signaling in a timeframe is particularly 
1 5 useful for ensuring a constant updating of the information stored in the pluraUty of 
agents. The exact signahng timeframe used may vary according to the needs of a 
particular embodiment. 



The operation of the present invention may also be embodied in a computer program 
20 product stored on a computer writable medium such as an optical storage device such as a 
compact disc (CD) or digital versatile disc (DVD), or a magnetic storage device such as a 
floppy disk or magnetic tape. 
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